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1.0  INTRODUCTION 


At  the  urging  of  Jean  Thi6baux  and  David  Parrish  of  the 
National  Meteorological  Center,  I  recently  extended  some  simula¬ 
tions  reported  on  previously  (see  Franke,  19S5)  to  include  an 
idea  advanced  by  Bratseth  (1986).  The  scheme  proposed  there  is 
an  iterative  scheme  for  objective  analysis,  similar  to  successive 
correction  methods  (SCM)  (see  Cressman  (1959)),  with  the  weights 
chosen  in  such  a  way  that  the  iteration  converges  to  the  results 
of  a  statistical  interpolation  (SI)  scheme  (see  Gandin  (1963)). 
This  would  appear  to  be  attractive  because  of  the  ease  of  ap¬ 
plying  SCM  and  the  skill  of  SI.  The  question  that  remains  is 
whether  or  not  the  proposed  scheme  converges  rapidly  enough  in  a 
practical  setting  to  justify  its  use.  The  simulations  described 
in  this  report  were  close  to  realistic.  Further  investigation  of 
properties  of  the  scheme  give  information  about  why  the  method 
performs  as  it  does  in  the  simulations  and  whether  similar  re¬ 
sults  can  be  expected  in  practice. 

The  second  section  reviews  the  ideas  of  Bratseth,  and  dis¬ 
cusses  a  generalization  of  the  scheme  within  the  context  of 
iterative  methods  for  solving  linear  systems.  In  the  third 
section  the  results  of  the  simulations  corresponding  to  those 
performed  in  Franke  (1985)  are  presented  with  some  conclusions. 
Section  4  gives  suggestions  for  further  investigation. 

2.0  THE  BRATSETH  METHOD 

The  basis  for  the  method  flows  from  the  following  ideas. 

Let  observation  points  xl,  i=l,...,n  be  given,  and  let  c^  repre¬ 
sent  the  spatial  covariance  between  the  background  plus  observa- 


tion  errors  at  points  xl  and  x,  while  c^  represents  the  cova¬ 
riance  between  the  background  errors  at  x1  and  x,  the  latter  an 
arbitrary  point  at  which  the  background  error  is  to  be  estimated. 
Then  the  weights  p^,  j  =  l,...,n,  -for  the  SI  correction  at  point  x 
are  the  solution  of  the  equations 
n 

(1)  Z  c.  p  =  c.  ,  i  =  l,...,n  , 

ix ’  ’  ’  ’ 

with  the  analyzed  values  being  given  by 

(la)  FA  =  FP  +  Z  p.(F°-FP)  . 

x  x  J 

A  F'  Q 

Here  F. ,  F-,  and  F.  represent  the  analyzed,  predicted  (back- 

i  A 

ground)  ,  and  observed  values  at  point  x  ,  respectively,  while  F^ 

and  F^  represent  analyzed  and  predicted  values  at  x. 

Using  SCM  with  the  spatial  covariance  function  as  the  weight 

function  yields  the  iteration 


(2) 


FA ( k+ 1 >  =  FA<k>  +  Z  a  (F°(k) -FA (k> >  , 

x  X  xj  j  j  ’ 


where  a  is  c  /M  .  for  some  normalizing  factor  M  ,  which  is 
xj  xjxj  ^  x  j  ’ 

typically  taken  to  be 


n 


Bratseths  observation  is:  if  equation  (2)  is  used  to  evaluate 

A 

the  F^(k),  instead  of  interpolating  from  the  grid,  then  the 

iteration  given  by  (2)  will  converge  (when  it  converges)  to  the 

solution  of  (1),  provided  the  M  's  are  chosen  independent  of  x. 

^  J 

This  observation  (in  a  limited  sense),  was  also  made  by  Franke 

and  Gordon  (1983),  where  the  M  's  were  all  taken  to  be  the  same. 

x  j 


The  key  to  analyzing  the  behavior  of  the  iteration  lies  in 


the  iteration  at  the  observation  points,  since  the  grid  point 


values  (while  being  the  real  interest)  have  no  effect  on  conver¬ 
gence.  In  matrix  form,  the  iteration  for  analyzed  values  at  the 
observation  points  has  the  form 

(4)  FA(k+l)  =  FA(k>  +  A(F°(k)-FA(k) )  , 

where  A  is  the  matrix  (a.  /M .  .),  F^  is  the  vector  of  observed 

1  j  1  j  ’ 

A  th 

values  and  F  (k)  is  the  vector  of  analyzed  values  (k  iteration) 

at  the  observation  points.  The  predicted  values  at  the  observa- 

P 

tion  points  (obtained  by  interpolation  from  the  grid),  F  ,  are 

(S 

used  as  the  initial  iterate,  F  (0).  Since  the  values  of  M  are 

^  J 

to  be  chosen  independent  of  x,  denote  them  by  M^  .  Then  A  is  of 

the  form  A  =  CM,  where  C  =  <c.  .)  and  M  =  diaq (M  ). 

i  J  J 

Bratseth  suggests  (in  our  context  of  independent  observation 
errors ) 


M 

l 


n 

=  £ 
j  =  l 


,Cij' 


The  effect  of  this  set  of  M  ’ s  will  be  to  ensure  that  the  matrix 
has  all  (absolute)  column  sums  equal  to  one.  This  shows  that  all 
eigenvalues  of  A  are  bounded  by  one,  and  since  A  is  positive 
definite,  all  eigenvalues  are  between  zero  and  one.  The  itera¬ 
tion  matrix  for  the  scheme  is  I-A,  which  is  then  seen  to  have  all 
eigenvalues  between  zero  and  one,  as  well,  ensuring  convergence 
of  the  scheme.  The  rate  of  convergence  is  proportional  to  the 
largest  eigenvalue  of  I-A,  therefore  when  A  has  small  eigenvalues 
the  convergence  is  slow. 

Replacing  the  matrix  A  by  A/k  (equivalently,  replacing  the 
M^  by  «Mj )  will  result  in  a  convergent  scheme  provided  u  lies 
within  certain  limits  as  noted  by  Bratseth  in  another  context. 


0<a  l<2.  Let  x^  represent  the  eigenvalues  of  A,  in  decreasing 
order.  Then,  values  of  a  greater  than  one  will  cause  slow  con¬ 
vergence  since  the  largest  eigenvalue  of  I-A/«  will  be  1-x  /«>1- 

n 

*  .  Thus,  to  minimize  the  largest  eigenvalue  of  I-A/a,  one 

should  take  a  to  satisfy  a  =  <X  -t-x,)/2.  Because  of  the  unknown 

n  l 

properties  of  the  associated  eigenvectors  relative  to  the  error 

in  the  initial  iterate,  such  a  value  will  probably  not  be  optimum 

for  a  scheme  which  does  not  iterate  to  convergence.  In  any  case, 

computation  of  X  and  X  is  not  feasible  in  practice.  I  also 

in 

note  that  as  a  parameter ,  «  1  behaves  much  the  same  way  as  an 
over-rel axati on  factor  such  as  used  in  Gauss-Seidel  and  other 
iterative  schemes  for  1 i near  systems  of  equations. 

3.0  SIMULATION  RESULTS 

The  basic  simulations  performed  for  a  variety  of  objective 
analysis  schemes  in  Franke  <1985)  (see  that  paper  for  details  of 
the  simulations)  were  conducted  for  several  variations  of  the 
Bratseth  method.  Initial  guesses  at  the  analyzed  values  were 
obtained  by  piecewise  cubic  interpolation  of  predicted  values 
from  the  grid  to  the  observation  points.  The  parameters  for  the 
simulations  were:  500  mb  height  field  (see  Koehler,  1979), 
standard  deviations  of  the  error  in  the  predicted  and  observed 
values  are  30  m  and  10  m,  respectively,  and  the  assumed  (and 
true)  correlation  function  for  the  predicted  error  was  the  iso- 
tropic  negative  squared  exponential,  ex p ( - ( d / 1 0 ) “ ) ,  where  d  is 
distance  in  degrees.  The  results  for  the  Bratseth  scheme  using 
3,  5,  and  10  iterations,  with  «  =  1.0,  0.75,  0.65,  and  0.55  are 
given  in  Table  1. 
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No.  It. 

«  =  1.0 

«  =  0. 75 

a  =  0.65 

a  =  0.55 

3 

10.48 

9.  34 

9.  27 

12.  75 

10.24(2.27) 

9. 13(1.97) 

9.05(2.02) 

11.91(4.57) 

5 

8.82 

8.04 

7.  77 

9.80 

8.63(1.80) 

7.89(1.59) 

7.62(1.53) 

9.33(2.99) 

10 

7.33 

6.91 

6.75 

7.02 

7.20(1.40) 

6.79(1.31) 

6.63(1.28) 

6.88(1.39) 

•  (  =  >01 ) 

6. 09 

6.09 

6.09 

6.09 

5.98(1. 19) 

5.98(1.19) 

5.98(1. 19) 

5.98(1. 19) 

Table  1:  RMS  analysis  errors  -for  Bratseth's  scheme.  This  table 
corresponds  to  entries  in  Table  2,  PW  cubic  column  in  Franke 
(1985).  Entries  are:  RMS  analysis  error 

Mean  RMS  error  (Std.  Dev. ) 

The  table  shows  that  (in  this  context)  the  scheme  is  less 
skillful  than  Barnes'  scheme  for  three  iterations,  while 
additional  iterations  and  smaller  values  of  a  yield  a  scheme 
which  is  more  skillful  than  Barnes'  scheme.  If  the  iterations 
are  continued,  the  scheme  converges  to  SI  (01  here,  since  the 
actual  statistical  properties  have  been  assumed),  however  it  is 
doubtful  that  more  than  10  iterations  would  be  cost  effective  in 
practice.  Use  of  smaller  values  of  «  are  seen  to  be  quite  useful 
for  the  ear  1 y  iterations.  In  this  case  the  smallest  eigenvalue 
of  A  is  X^  <  0.01,  whereas  X^  =  1,  which  indicates  the  optimum 

value  of  «  is  close  to  0.5  .  However,  RMS  errors  for  a  few 
iterations  tend  to  be  larger  when  c<  =  0.55,  probably  because  the 
decomposition  of  the  error  in  terms  of  eigenvectors  results  in 
larqer  components  corresponding  to  X  ,  which  is  slowly  damped  if 
c«  is  near  its  optimum  value.  Thus,  the  optimum  value  of  w  for  a 
given  number  of  iterations  is  somewhere  between  the  theoretical 
optimum  and  «= 1 .  Note  that  for  3  iterations,  the  RMS  errors  with 
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«  =  0.75  and  «  =  0.65  are  nearly  the  same,  while  for  a  =  0.55  the 
error  is  larger.  As  the  iteration  count  increases,  faster 
convergence  rates  occur  for  the  smaller  values  of  a. 

Table  2  shows  something  of  the  the  sensitivity  of  the  scheme 
to  mi sspec i f i cat i on  of  the  ratio  between  prediction  and 
observation  errors.  The  set  of  realizations  was  different  here 
than  for  those  that  made  up  Table  1,  which  accounts  for  column  1 
of  Table  2  differing  from  column  3  of  Table  1.  The  rate  of 
convergence  seems  to  be  improved  slightly  here,  although  the 
performance  of  SI  is  deter i orated . 


No .  It. 

a  -  0.65 

rgl i e=20 

rol i e=5 

3 

9.88 

9.59 

9.69 

9.67(2.05) 

9.34(2.21) 

9.50(1.93) 

5 

8.37 

8.  26 

8.21 

8.21 (1.65) 

8.05(1.86) 

8.04(1.67) 

10 

7.30 

7.24 

7.  12 

7.16(1.45) 

7.07(1.57) 

6.97(1.44) 

®  ( =  >S  I ) 

6.40 

6.47 

6.88 

6.27(1. 30) 

6.32(1 . 35) 

6.  74 ( 1 . 38) 

Table  2:  RMS  analysis  errors  for  Bratseth's  scheme.  This  table 
corresponds  in  part  to  Figure  13,  Franke  (1985).  Nominal  values 
of  r  and  r  were  30  m  and  10  m,  respectively,  while  the  analysis 
was  given  28  m  and  5  m,  respectively  for  columns  2  and  3. 

Entries  are:  RMS  analysis  error 

Mean  RMS  error  (Std.  Dev.). 

Based  on  these  simulations,  it  is  not  clear  that  the  method 
is  superior  to  a  highly  tuned  version  of  Barnes  scheme,  for  a 
r  eisonable  number  of  iterations.  Sensitivity  to  mi sspec i f i cat i on 
of  the  correlation  function  *.as  not  investigated,  but  this  can  be 
expected  to  be  similar  to  that  of  statistical  interpolation  since 


the  scheme  converges  to  the  SI  approximation. 


4.0  FURTHER  THOUGHTS 


The  analysis  of  iterative  methods  for  linear  systems  reveals 
that  the  components  of  the  error  vector  correspondi ng  to  large 
eigenvalues  of  the  iteration  matrix  are  most  slowly  damped.  The 
1 arge  eigenvalues  of  I-A/a  correspond  to  the  small  eigenvalues  of 
A  in  the  present  discussion.  The  eigenvectors  correspondi ng  to 
small  eigenvalues  tend  to  have  "spikes"  at  a  few  of  the 
observation  points.  Because  of  this  it  is  possible  that  the 
errors  left  after  a  finite  number  of  iterations  correspond  to 
components  which  will  be  damped  out  during  the  initialization 
phase,  prior  to  beginning  the  numerical  integration  of  the 
dynamical  equations  in  NWP.  Thus,  it  is  possible  that  in  a 
practical  setting  the  performance  of  the  Bratseth  scheme  may  be 
much  better  than  indicated  by  the  raw  RMS  errors  shown  in  Table 
1.  Whether  or  not  this  is  the  case  will  probably  be  quite 
difficult  to  determine  without  commitment  of  significant 
resources  to  conduct  full  scale  verification  runs. 
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